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Introduction 

by General John R. Dailey 


The Government Performance and Re- 
sults Act (GPRA) passed by Congress 
and signed by the President in 1993 
provides a new tool to improve the ef- 
ficiency of all Federal agencies and to 
ensure that intended results are deliv- 
ered to agencies’ customers. This Act 
requires that, beginning in the FY99 
budget request, agencies submit a 
strategic plan for program activities 
and an annual performance plan cover- 
ing those activities set forth in the bud- 
get. NASA has established a Strategic 
Management System to implement our 
Strategic Plan and provide the infor- 
mation and results to fulfill the plan- 
ning and reporting requirements of the 
GPRA. The System is described in the 
recently released fourth installment of 
the NASA Strategic Plan and is further 
defined in the NASA Strategic Man- 
agement Handbook . NASA’s GPRA 
submittals to the Office of Manage- 
ment and Budget and Congress are 
fully compliant with the GPRA and 
address outcome- and output-oriented 
performance measures, ISO 9000, and 
full cost management. Consistent with 
these initiatives, NASA continues to 
revolutionize the way we do business 
using the Strategic Plan framework of 
four Strategic Enterprises and four 
Crosscutting Processes described in 
the Strategic Plan and Strategic Man- 
agement Handbook. 

A key aspect of NASA’s new Strategic 
Management System is improving the 
way we plan, approve, execute and 
evaluate our programs and projects. To 
this end, NASA has developed the 
NASA Program and Project Manage- 
ment Processes and Requirements- 
NASA Procedures and Guidelines 


(NPG) 7 120. 5 A, which formally docu- 
ments the “Provide Aerospace Prod- 
ucts and Capabilities” crosscutting 
process, and defines the processes and 
requirements that are responsive to the 
Program/Project Management-NASA 
Policy Directive (NPD) 7120.4A. The 
Program/Project Management- NPD 
7120. 4A, issued November 14, 1996, 
provides the policy for managing pro- 
grams and projects in a new way that 
is aligned with the new NASA envi- 
ronment. An Agency wide team has 
spent thousands of hours developing 
the NASA Program and Project Man- 
agement Processes and Requirements- 
NPG 7 120. 5 A. We have created signif- 
icant flexibility, authority and discre- 
tion for the program and project man- 
agers to exercise and carry out their 
duties, and have delegated the respon- 
sibility and the accountability for their 
programs and projects. 

Now that we have formally described 
how we will do business, it is incum- 
bent upon program and project man- 
agers to read and understand NASA’s 
policy and processes. It is up to each of 
us to understand the guiding documen- 
tation within the process we are oper- 
ating. Over the last several years, 
we’ve heard people say: “I never real- 
ized that’s how we were supposed to 
do it.” We spend a significant amount 
of time writing and coordinating NPDs 
and NPGs only to get them published, 
and then fail to read and follow them. 
The GPRA establishes a clear focus on 
achieving results and this documenta- 
tion establishes the criteria by which 
we conduct our business. We will be 
graded on our ability to meet the pro- 
gram requirements established in Pro- 
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gram Commitment Agreements as re- 
quired by the NASA Program and Pro- 
ject Management Processes and Re- 
quirements-NPG 7120.5A. It is going 
to be a significant change because it 
won’t just be performing “close” to 
what we said, but rather, we either did, 
or didn’t, do it as defined, and it’s go- 
ing to be easy for the Government Ac- 
counting Office, Inspector General, 

ISO 9000 auditors and others to evalu- 
ate whether that’s the case. It is essen- 
tial that we say what we will do, and 
do what we say. 

We must quickly and efficiently imple- 
ment the NASA Program and Project 
Management Processes and Require- 
ments-NPG 7120.5A throughout 
NASA. The articles that follow are de- 
signed to provide the background for 
beginning this implementation process. 
Visits to each Center have been ar- 
ranged to communicate the new pro- 


cess and to facilitate rapid ownership 
and implementation. In addition, a 
training session will be included as 
part of these Center visits to communi- 
cate the NASA Program and Project 
Management Processes and Require- 
ments-NPG 7120.5A personnel train- 
ing available to sustain the process. 

The description of our processes and 
requirements in the NASA Program 
and Project Management Processes 
and Requirements-NPG 7120.5A pro- 
vides the over-arching description of 
“what” program and project managers 
must do in this new NASA environ- 
ment-it provides for us the way we 
will produce for the future and achieve 
the results promised in our GPRA 
Strategic and Performance Plans. I en- 
courage each of you to use the NASA 
“can do” attitude to weave this new 
management process into the fabric of 
the Agency. 
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NASA Procedures and Guidance 7120.5A: 
An Overview 

by Carolyn S. Griner 


Over the past few years we have faced 
a significantly different environment, 
with generally smaller projects and less 
time to do our projects and programs. 
The revolution within the Agency of the 
new Strategic Management Handbook 
and the change in management struc- 
ture and responsibilities has driven 
changes in both process and require- 
ments. We have diminishing resources 
with increasing work to do, which 
means we must be more effective and 
efficient. There is also a government- 
wide emphasis on commercialization 
and technology transfer that has really 
not been incorporated into the main- 
stream of our program and project 
management process. There are more 
and more opportunities for improve- 
ment in terms of changing acquisition 
rules and changing processes in govern- 
ment, providing us with more options to 
procure and develop our goods and ser- 
vices. NASA also has the obligation 
under the Government Performance and 
Result Act to make sure our perfor- 
mance can be measured and reported to 
our customers’ expectations. 

The revolution and shaping of the 
Agency to meet the imperatives of the 
new environment is continuing, and 
NPG 71 20.5 A is the next step. The 
1998 NASA Strategic Plan states that 
we are to deliver world-class programs 
and cutting-edge technology through a 
revolutionized NASA. Process and re- 
quirements must change to insure suc- 
cess in delivering those world-class pro- 


grams. The 1996 Strategic Manage- 
ment Handbook defines the Agency’s 
crosscutting processes: “Manage 
Strategically,” “Provide Aerospace 
Products and Capabilities,” “Generate 
Knowledge” and “Communicate 
Knowledge.” The focus of this 
overview, and for the development of 
programs and projects, is the “Provide 
Aerospace Products and Capabilities” 
process. 

NASA Policy Document 7120.4A spec- 
ifies the management system policy for 
the development and operation of pro- 
grams and projects. NPG 7 120.5 A de- 
scribes the next tier of requirements, 
integrating those crosscutting processes 
and process-focused requirements, 
making sure we can be flexible and effi- 
cient, providing the right kind of prod- 
uct delivery that meets user require- 
ments. 

Major Themes 

Basic themes were developed to provide 
the foundation for the new processes 
and requirements. One certain fact in 
the program and project world today is 
that “one size does not fit all.” We had 
to look at not only the process and re- 
quirements that we were going to use, 
but also how well they could be tailored 
to accommodate the very small NASA 
projects as well as the very large pro- 
grams. That comes as no easy task, so 
“process tailoring” is a central theme 
throughout the document. 
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Another theme, derived from a finding 
of the initial process team under Joe 
Rothenberg at Goddard, is that the user 
and the customer need to be involved in 
the process end-to-end. We need to un- 
derstand their requirements thoroughly, 
have them involved in the evaluation of 
the product throughout its development, 
and get some feedback as they use the 
product or service the Agency provides. 
We must have comprehensive definition 
and requirements control. We must do 
what we say we are going to do; there- 
fore, we need a complete understanding 
of what it is we are trying to accom- 
plish, when we are going to accomplish 
it, and what the requirements are. The 
process must be able to deal with the 
variations that are factors in all pro- 
grams and projects. 

Another theme focuses on risk manage- 
ment. What are the risks involved in a 
new program or project? How likely are 
they and how serious will the conse- 
quences be if the risks are realized? 
Which are the most important risks fac- 
ing the program or project manager — 
the ones we really need to worry about? 
How can we mitigate the identified 
risks? Are the mitigation actions actu- 
ally implemented and are they effective 
in reducing risk? If they are not effec- 
tive, perhaps we need to rethink them. 
These are some of the questions that 
program and project managers need to 
be asking continuously — especially 
when we are applying cutting-edge 
technology to enable new missions (a 
departure from the past when we 
merely derived new technology from 
missions we currently had underway). 

Aggressive technology commercializa- 
tion is a theme that is critical to NASA 
and the nation. NASA is in the process 
of preparing for ISO 9000 registration. 


This new approach for program and 
project management must be compliant 
and enable the process and require- 
ments interface so Field Centers can 
link to top-level policy and guidance. 
The “Provide Aerospace Products and 
Capabilities” process, started under Joe 
Rothenberg at Goddard and currently 
under the leadership of NASA Chief 
Engineer Dan Mulville, provides an in- 
tegrating roadmap for accomplishing 
our objectives. 

Major Objectives 

In light of these themes and challenges, 
we established a set of objectives in 
dealing with the document in order to 
have a process-managed approach. And 
I would have to say there are a lot of us 
who are not sure exactly what that 
means. So, we are going to be learning 
as we go through this - but the first 
thing is to understand the process. 

The 1996 Strategic Management 
Handbook has processes for technology 
development, ground systems and oper- 
ations, and flight systems development, 
but they are separate. However, when 
we look at the way we should be doing 
business, they all should be integrated. 
Proper attention must be paid to the 
technology required for the space, 
ground, data and operations systems 
and then to the infrastructure required 
to get the job done. Unless you do all 
that on an integrated basis, you run a 
real risk of not putting the appropriate 
program or project in place. 

Tailoring the program or project plan- 
ning with the appropriate levels of in- 
sight leads to very high-level require- 
ments. With the appropriate level of 
management oversight relative to both 
the risk and criticality, and the cost in 
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line with NASA policy, a particular 
product or service development could 
still be extremely tailorable. 

Requirements are built around process, 
products and the interacting activities. 
The old NHB 7120.5 described a very 
serial operation — it was A, B, C, D 
and E. Few, if any, projects can follow 
a serial process without doing concur- 
rent engineering or the concurrent coor- 
dination with the budget process and 
the congressional process. Therefore, a 
more flexible and concurrent approach 
was developed. 

The interfaces with other NASA cross- 
cutting processes also need to be incor- 
porated. It is not enough to say there 
are four of them; you must also under- 
stand how they interact with each other 
and how a program or project manager 
is affected by the four processes. 

Implementing the Objectives 

Many very exciting things are going on 
in the Agency today, including innova- 
tion in program and project manage- 
ment. In NPG 7 120.5 A, we tried to 
capture all of that and yet allow and 
even encourage innovation. In the im- 
plementation of these objectives, this 
document is intended to be a 
Headquarters-level requirements docu- 
ment that authorizes and enables Center 
processes and requirements, consistent 
with the ISO 9000 approach. The tai- 
loring of those processes and products 
to meet the needs of a program and pro- 
ject can easily be done. The require- 
ment is to look at the all the elements 
and the activities in the process and ad- 
dress them. The decisions made on 
those elements must be documented and 
agreed to by the appropriate levels of 
management. You can change a lot of 
things, but the process requires a re- 


view that creates thoughtful agreement: 
yes, we agree that’s the right way to do 
business; yes, that’s the right amount of 
risk; or yes, that’s the right level of 
oversight. Early in this process we 
looked at whether we should differenti- 
ate categories of work or take large ef- 
forts and separate them from the 
smaller efforts. We found out that was 
very difficult to do. 

So many different activities are going 
on in the Agency today. Some are small 
but critical, some are small and high 
risk, some are large but lower risk, and 
some are large, high risk and very visi- 
ble. So there is no easy way to pre- 
classify the kind of work we are doing, 
going into it. 

We think the process-based approach 
and the tailoring capability meet those 
differing needs more effectively. We 
have provided flexibility for different 
Enterprise and Center approaches. I 
think that you will find that if you un- 
derstand the process and look at how 
you are doing business today, you will 
find a good “fit.” It has been really in- 
teresting to look at the innovations in 
the Agency today, and then to define a 
helpful process for all kinds of busi- 
ness. 

The application of risk management 
throughout the life cycle is very impor- 
tant and it is something we emphasized 
in NPG 7 120.5 A. We are trying to say 
that you do not just consider risk on the 
front end of your program during For- 
mulation and then walk away from it. 
Risk management should be continuous 
and should be the basis of good deci- 
sion making throughout the life cycle. 

The management responsibility and ac- 
countability defined in the Strategic 
Management Handbook has been 
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somewhat expanded; it empowers pro- “Implementation” is the execution of 
gram and project managers, and it in- the requirements and plans, puts all the 
corporates insight and oversight mecha- pieces together, and measures against 
nisms. the metrics in the plans. “Evaluation” is 

the last subprocess, and it provides both 

Program/Project Management customer and independent assessment. 

Process Elements Evaluation is not used in this document 

as a term that includes the internal pro- 

Four basic process elements, called gram/project reviews, such as design 

subprocesses, are contained in both review, which are part of your internal 

NPD 71 20.4A and NPG 71 20.5A. One program and project management pro- 

is “Formulation,” which defines pro- cess. The independent assessment has 

grams/projects that meet users’ require- the customers involved so you under - 
ments. It consists of gathering require- stand that you are, in fact, meeting their 
ments and concepts together, under- requirements and addressing their spe- 

standing what you are trying to accom- cific concerns continuously throughout 

plish, and defining the plans to get the process, 

there. “Approval” is the governing Pro- 
gram Management Council process that Process Alignment 
approves or modifies a baseline pro- 
gram or project. It is active in the early The “Provide Aerospace Products and 

stage of a program or project and Capabilities” (PAP AC) process is rep- 

throughout the life of the project. resented on the right side of Figure 1 . 



Figure 1. Top Level Process Activities Aligned with NPD 7 120. 4 A 
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Figure 2. Program and Project Relationship 


It is important to note that the four sub- 
processes are highly interactive. You 
move from place to place within the 
larger process, depending on where you 
are in the program or project. All of 
those things interact in a process sense. 

There is also active interaction with the 
other three crosscutting processes men- 
tioned earlier: “Manage Strategically,” 
“Generate Knowledge” and 
“Communicate Knowledge.” Program 
and project managers have a responsi- 
bility for the interaction with those pro- 
cesses, too. 

Program/Project Flow 

It is also important to see how pro- 
grams and projects flow through the 
PAP AC process. Figure 2 is complex, 
but if you understand this chart, you 
will start to understand the process flow 


you are going to see in the document. 

In the upper left is Program Formula- 
tion, the very early stage of program 
development under the responsibility of 
the Enterprise Associate Administrator 
who must define programs that meet 
both the NASA Strategic Plan and the 
Enterprise Strategic Plan. The docu- 
ments justify the formulation of a par- 
ticular program; that is, they authorize 
the expenditure of resources to get that 
work done. Formulation documents are 
then generated and go to the Agency 
Program Management Council (PMC). 
They go to the PMC, although only the 
Administrator is authorized to approve 
programs, but the PMC, under Deputy 
Administrator Jack Dailey, makes a 
recommendation to the Administrator, 
based on the completeness and appro- 
priateness of the program that has been 
formulated. In the dotted box under 
Program Formulation, there may be 
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some projects being formulated during 
the same time frame. In other cases they 
are not, so we have to allow for that 
kind of timing and event flexibility. 

During the Approval subprocess, the 
governing PMC is assigned and may 
be, for instance, the lead Center PMC 
for some programs. That is allowed af- 
ter the Agency PMC has approved a 
particular program, then it is delegated 
to the appropriate level. Again, the keys 
to success are tailoring what you are 
trying to do and getting the decision 
documented across the board so that 
everyone understands the way you are 
doing business. 

Once you accomplish Formulation, you 
are basically in the process of imple- 
menting the program itself. While gen- 
erating Implementation documentation 
for the program, you may still be for- 
mulating projects. We have many ongo- 
ing programs that are developing pro- 
jects as they go through their life cycle. 
Those additions can be accommodated 
in the budget process. An example of 
those additions would be Shuttle up- 
grades during its operational phase. The 
additional new projects also go through 
an approval process at a governing 
PMC. Your program plan will specify 
these projects to be formulated and cite 
the Approval mechanism. When the 
new projects are approved by the gov- 
erning PMC, they are baselined and go 
into their Implementation process. Ob- 
viously, out of that process comes the 
project that is planned to meet the cus- 
tomers’ requirements. 

The bar across the top is that of Evalu- 
ation: the external and customer evalua- 
tions mentioned earlier. It is a process 
that is integrated throughout the life cy- 
cle of the program. You should con- 


stantly have customers involved, both 
to understand what you are doing and 
to demonstrate that you are meeting 
their requirements. I would encourage 
you not to think of the PAP AC as a se- 
rial activity. In fact, you can go from 
Formulation into Implementation and 
then find events, such as a budget or a 
technical challenge, that force you to go 
back and readdress how you formulated 
a particular program or project in the 
first place. 

Document Structure 

The document structure of NPG 
7 120.5 A is fairly straightforward and is 
designed as a total package for the use 
of program and project managers alike. 
The Overview provides a summary of 
the concept behind the document, the 
process itself, and how it all works to- 
gether. The Program Management sec- 
tion includes all the subprocesses men- 
tioned earlier. This is where the pro- 
gram manager will be able to find a 
self-contained section. The same ap- 
proach is provided for Project Manage- 
ment, which creates a great deal of du- 
plication from one to the other. How- 
ever, since the customers for this docu- 
ment are both program managers and 
project managers, it has been structured 
for their individual use. They will be 
able to pick up and have a total pack- 
age to understand all aspects of the pro- 
cess. 

Another section of the document in- 
cludes a chapter on program and pro- 
ject management Systems Require- 
ments. Examples are acquisition man- 
agement and financial management. 
Then 7 120.5 A moves across all phases 
and parts of the process. There may be 
a different emphasis depending on 
where you are in the program or pro- 
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ject, but those are the things that pro- 
gram and project managers need to do, 
regardless. 

The Agency has met the challenges of 
baselining the new paradigms in pro- 
gram and project management. The 
alignment of program and project man- 


agement with the Strategic Plan is in 
place. It is now our job as Enterprise 
Associate Administrators, Center Di- 
rectors, and program and project man- 
agers to use the more creative and flexi- 
ble approach to, as Jack Dailey puts it, 
“produce the future.” 
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The Impact of NPG 7 1 20.5A upon 
Training and Development 


by Dr. Edward J. Hoffman 

NASA Procedures and Guidance 
7120.5A for Program and Project Man- 
agement Processes and Requirements 
should have minimal effect upon cur- 
rent Agency training and development 
programs — mainly because the new 
directive simply formalizes what we 
have been teaching and learning in the 
NASA Program/Project Management 
Initiative all along. 

A frequent complaint we get from the 
8,000 or so graduates of our PPMI 
courses over the years, however, deals 
with resistance to what they may have 
learned in the classroom or training site. 
Brimming with new ideas, these young 
men and women often run up against an 
entrenched program or project manager 
who insists that things be done “the old 
way,” too often perceived as “the 
NASA way” or even “the Goddard 
(Lewis, Kennedy, Johnson, JPL, Sten- 
nis, etc.) way.” 

Management was all too often in the 
eyes of the manager; now we’re all 
reading from the same book, 7 1 20.5 A. 
Still, there is no single method or “one 
size fits all” approach to project man- 
agement in NASA. While each Center 
is responsible for developing policies, 
processes and procedures to comply 
with the new NPG, individual program 
and project managers will still need to 
tailor their requirements to the specific 
needs of the project, consistent with the 
size, complexity, risk and criticality of 
the project. Under NPG 7 120. 5 A, the 
results of such tailoring are to be docu- 
mented in agreements among managers, 


directors, Enterprise Associate Admin- 
istrators and the Administrator. 

The PPMI organization is ready to meet 
the challenge of the new 7 120. 5 A direc- 
tive. Fortunately, many of those cur- 
rently involved (and in NASA most of 
us are) in program or project manage- 
ment are already familiar with and ex- 
perienced in the new methods of project 
formulation, approval, implementation 
and evaluation. The management of fi- 
nance, risk, performance and acquisi- 
tion, as well as safety and mission as- 
surance, is much the same as we have 
taught, learned and practiced in recent 
years in the NASA PPMI. In fact, right 
at the top of our Level One description 
of “Work/Development Experiences” in 
the PPMI Career Development manu- 
als, the first items “most critical to job 
performance” are NASA Management 
Instruction 7120.4 and NPG 7120.5A. 
We ask our participants to read and be 
familiar with both, discuss them with 
experienced project managers, and use 
them as constant reference tools. 

A New Directive 

The sweeping changes called for in 
NPG 7 120.5 A include a major empha- 
sis on training, development and contin- 
uous learning for program and project 
managers. As the NPG says, “The peo- 
ple who manage, support and work on 
projects require a vast sum of knowl- 
edge, experience and skill in the profes- 
sion of project management.” In the 
early days of NASA, project managers 
were expected to learn project manage- 
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ment skills and knowledge on the job, 
but in the past decade the Agency has 
provided a wide array of development 
opportunities and resources through the 
NASA Program and Project Manage- 
ment Initiative (PPMI). These resources 
can be referenced through the PPMI 
home page (http://ppmi.hq.nasa.gov), 
the NASA PPMI Charter and the 
NASA Project Management Develop- 
ment Process (PMDP) Handbook. 

As the PMDP Handbook and NPG 
7 120. 5 A indicate, the responsibility for 
proper project management develop- 
ment is shared by the individual and his 
or her manager. The NPG states: 
“Managers shall support employees in 
receiving the proper development and 
continuous learning.” Specifically, all 
NASA program and project managers 
should receive: 


• Formal training and developmental 
experiences which promote optimal 
PPM performance. 

• Access to PPM tools and informa- 
tion services through the NASA Pro- 
gram/Project Management home 
page. 

• Work assignments that provide 
growth and preparation for PPMI 
assignments. 

NPG 7 120.5 A also establishes the fol- 
lowing requirements for minimal formal 
training and continuous learning: 

a. Maintain competence in project 
management by making a commit- 
ment to continuous learning is essen- 
tial. This learning can take place in 
the form of formal training, develop- 


Level of Development 

Formal Training Courses (or equivalency) 

Program Manager 

NASA Program Management (PGM) 

NASA Advanced Project Management (APM) 
An Overview of NASA Program/Project 
Management: 7120.5A 

Project Manager 
(Systems Level and 
Above) 

NASA Advanced Project Management (APM) 
An Overview of NASA Program/Project 
Management: 7120.5A 

Project Manager 
(Subsystems Level) 

NASA Project Management (PM) 

An Overview of NASA Program/Project 
Management: 7120.5A 
System Requirements 
Systems Engineering 

Project Personnel 

NASA Task Management (TM) 

An Overview of NASA Program/Project 
Management: 7120.5A 
Fundamentals of Program Management 
and Control 


Figure 1. Matrix of Required Training Courses by Career Level 
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mental assignments, academic pro- 
grams, or self-paced study. Pro- 
gram/project managers as well as 
program/project personnel shall have 
an annual minimum of 40 hours of 
project management-related learning 
and are strongly encouraged to par- 
ticipate in at least another 40 hours 
of general learning each year. In or- 
der to ensure personal and organiza- 
tional commitment to learning, Indi- 
vidual Development Plans (IDP) 
shall be developed and supported by 
all project personnel and their man- 
agers. NASA Senior Management 
shall promote an environment which 
enables such continuous learning to 
occur. 

b. The matrix of required courses by 
career level (Figure 1) indicates the 
minimum formal training required. 
Program/project personnel should 
supplement these requirements by 
taking additional formal training 
which is person- and position- 
specific. A list of NASA PPM train- 
ing and development resources can 
be found through local training and 
development organizations as well as 
the NASA PPMI. 



Figure 2. Integrated PPM! Model 


shared experiences and best practices 
were key concepts then and now. PPMI 
is an integrated process of development 
with full support from senior leadership 
as well as clear customer interest and 
involvement. 


A Bigger Picture 

PPMI is not just the source of training 
courses. Founded ten years ago on the 
assumption that commercial training 
materials would be tailored for NASA 
practitioners, PPMI was never meant to 
compete with academia or industry, but 
rather to complement and integrate ar- 
eas of expertise into an orderly, sensible 
career development process. 

PPMI has always endeavored to be in- 
clusive, not exclusive; to synthesize 
learning and experience, not separate or 
categorize them. Lessons learned, 


The best way to see how PPMI can be 
used to train virtually an entire agency 
in NPG 7120.5A is to view PPMI in 
terms of a five-prong process of contin- 
uing development. 

The Integrated PPMI Model shown in 
Figure 2 makes most sense when it is 
viewed as a well-rounded process of 
professional project management devel- 
opment, in contrast to a single training 
curriculum or “quick-hit” training 
events. NPG 7 120.5 A itself is multi- 
faceted, and to focus on just one aspect 
could be myopic for the project 
manager. 


The Impact of 7120.5A Upon Training and Development 
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PPMI Training and Development Curriculum 

• Core Programs 

Project Management 
Advanced Project Management 
Program Management 
Task Management 

• Developmental Courses 

International Project Management 
Systems Engineering 

Technology Transfer and Commercialization 
Topics in Project Management 
Topics in Software Project Management 
Software Acquisition Management 
Software Process Improvement 
System Requirements 
Project Management Shared Experiences 
Program 

Multi-Project Management 
Project Planning and Scheduling 
Construction of Facilities Management 
Construction of Facilities Best Practices 
Fundamentals of Program Management and Control 
Program Control (seven modules) 

• Project Management Development Process (PMDP) 

Assignments 

• Professional Development Program (PDP) 

Rotations 


Figure 3. PPM i Training and Development Curriculum 


Instead, connections are made between 
Intact Team Support, for example, and 
the PM Tools and Information Technol- 
ogy that make it happen, help prepare it 
and become useful for follow-up. Be- 
sides the obvious connection between 
Intact Team Support and PPMI Train- 
ing and Development courses, such 
support can and should feed into the 
overall NASA Project Management De- 
velopment Process. All five feed into 
the Program/Project Management Ini- 
tiative and emanate from it. 

A closer analysis of all five aspects of 
PPMI will show how NPG 7 120.5 A 
can saturate the entire NASA program 


and project management community 
quickly, efficiently and thoroughly. 

1. PPMI Training and Development 
Programs 

The most visible aspect of PPMI has 
been duly noted by the authors of NPG 

7 120.5 A, specifically the four core pro- 
grams - Project Management, Ad- 
vanced Project Management, Program 
Management and Task Management 
plus three of the developmental courses. 
More than 8,000 NASA employees 
have participated in PPMI’s core pro- 
grams and skills courses, including 
more than 2,000 in one or more of the 
seven modules of Program Control. 

Each of these courses is being updated 
to reflect the requirements of NPG 

7 120.5 A. In early December our execu- 
tive team of PPMI leaders and PPMI 
curriculum presenters met for four days 
in the Management Education Center at 
Wallops Flight Facility to make sure all 
instruction is aligned with the NASA 
Strategic Plan , 7 120.5 A and the Pro- 
ject Management Development Process. 
We looked at course objectives, prereq- 
uisites, target audiences, instructor 
qualifications, competency model fit/ 
placement, and experiential activities or 
substitutions. Presenters who could not 
attend were asked to participate in a 90- 
minute teleconference at the opening 
overview and a 120-minute session to- 
wards the end when they could answer 
questions or provide information to 
group leaders in breakout sessions. The 
materials at the latter sessions included 
course descriptions and outlines plus 
behavioral objectives, metrics and con- 
nections with American Council of Ed- 
ucation accreditation/certification, 

7 120.5 A, PMDP and the NASA Strate- 
gic Plan. 
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While our participants can be assured 
of the inclusion of the latest NPG 
7 120.5 A requirements in PPMI pro- 
grams, courses and sessions, they can 
also get annual updates at the Project 
Management Shared Experiences Pro- 
gram conducted each spring. Experts in 
their fields share their knowledge and 
skills at PMSEP gatherings as partici- 
pants network with each other and dis- 
cover new ways of managing programs 
and projects. 

PPMI training and development pro- 
grams are not limited to core training 
programs, skills courses and PMSEP. 
They also include informal mentoring. 
Part of career development at NASA 
involves transitional assignments in the 
PMDP or job rotations in the Profes- 


sional Development Program. Informal 
mentoring can expose a candidate to 
7 1 20.5 A requirements in performance, 
finance, risk, acquisition and safety and 
mission assurance in ways that text- 
books and courses can only approxi- 
mate. From the very beginning of 
PPMI, the stress has been on “both- 
and” instead of “either-or.” The well- 
rounded project manager has knowl- 
edge and experience, even if the latter is 
from a mentoring situation. 

2. Project Management Develop- 
ment Process 

Work assignments and job rotations in 
project management at NASA are usu- 
ally made in the context of an 
“Individual Development Plan” or IDP, 



Level One - Performs f undamental, basic 
and routine activities while gain in 9 subject 
matter expertise in requirements 
definition, using a WfflS in project pi anning, 
estimating project risk, cost&chedule 
estimation and reporting of work el entente, 
budgeting concepts, scheduling concepts, 
configuration management, and bas elin e 
control. 



Level Three- Performs in management Of a more 

subsystem 
cap abii ties 


parts/pieces, or other defined services, 
or products with associated Interfaces 



- Performs kt management of a 
simple project <for example, no mo re than 
one or two simple i ntern a ^external 
interfaces, smaller team, simpler contracting 
pro cesses , smaller budget , s horter duration, 
etc.) ; 



Performs in management of 
a complex program or set of complex 
projects with multipl e associated interfaces 


Figure 4. PMDP Process 
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based upon a participant’s past work 
record and career aspirations. The 
NPG 7120.5A becomes an essential 
guidebook for this process. 

Just three years ago NASA launched 
the Project Management Development 
Process, an effort to provide every 
member of the project management 
community with a clear roadmap of the 
PPMI courses and work experiences 
needed to ascend the four traditional 
levels of skills and knowledge, from 
project team member to major program 
manager. With PMDP, participants can 
baseline and benchmark their current 
capabilities, identify competency re- 
quirements, and build their own per- 
sonal development plans in conjunction 
with their supervisors and possibly a 
mentor. 


The mentor and/or supervisor will ex- 
amine the PMDP participant’s educa- 
tion, training and work experiences be- 
fore building an IDP together. The IDP 
may contain formal educational oppor- 
tunities as well as informal learning 
such as self-study, reading, research, 
conferences and job-related profes- 
sional activities. The IDP will also in- 
clude work assignments and job rota- 
tions, and possibly special projects or 
service on a task force. Training com- 
ponents include PPMI courses, pro- 
grams such as the Project Management 
Shared Experiences Program, seminars 
and workshops such as the briefings on 
NPG 7 120.5 A. 

The PMDP is designed so that the par- 
ticipant is ultimately responsible for 
developing the IDP. The supervisor of- 
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Figure 5. PPM! Home Page < http://ppmi.hq.nasa.gov > 
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Figure 6. NASA’s Site for On-line Learning and Resources (SOLAR) 


ten helps with new work assignments, 
and the mentor is a valuable source of 
encouragement and advice. But the par- 
ticipant sets up meetings with the su- 
pervisor and mentor and decides to fol- 
low the first piece of advice in the 
PMDP Handbook: “the most critical to 
job performance” are NASA Manage- 
ment Instruction 7120.4 and NPG 
7 120.5 A. 

3. Project Management Tools and 
Information Technology 

All planning efforts to train the entire 
NASA project management community 
in NPG 7 120.5 A begin and end with 


information technology and manage- 
ment tools. 

For well over a year, the PPMI home 
page has been providing the latest infor- 
mation on training opportunities, idea 
exchanges and research archives. 

In a work environment where timely 
information is crucial to mission suc- 
cess, the PPMI home page is available 
to the entire NASA project management 
community, including trainers, contrac- 
tors and managers at every level. The 
site is available at 
http://ppmi.hq.nasa.gov. 


The Impact of 7120.5A Upon Training and Development 
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The PPMI home page provides a link to 
the new indexed version of the 
NPG 7 120.5 A, as well as direct links to 
the NASA Strategic Plan and the NASA 
Strategic Management Handbook. 

With a click of the mouse, a user can 
search a listing for current NASA 
acronyms and submit new ones. A path 
to the NASA Lexicon provides a quick 
explanation of NAS A technical terms 
and abbreviations. The training button 
shows what NASA training is avail- 
able, when and where it will be held, 
and how to reply. An Archives section 
includes presentations, active projects, 
research studies, lessons learned and 
other materials valuable to program/ 
project personnel. 

Behind the “Archives” button, vast pro- 
ject management resources are avail- 
able for reference, reading and down- 
loading, whatever the information needs 
of the visitor. NASA’s Tools Informa- 
tion Guide is a handy reference to pro- 
ject management techniques used at 
NASA, and The Systems Engineering 
Handbook is a comprehensive reference 
to aerospace systems management. Two 
other PPMI publications are also on- 
line: Readings in Systems Engineering 
and Readings in Program Control, 
with a third on the management of ma- 
jor system programs in preparation. All 
14 editions of Issues in NASA Program 
and Project Management, including 
this one, can be found online as well. 

The newest addition to the NASA 
PPMI site is the PPMI Coach. Al- 
though currently under construction, the 
Coach will soon provide quick and ef- 
fective guidance (and materials to 
download) for project managers and 
support staff. Topics covered will in- 
clude: Work Breakdown Structure, 
Configuration Management, Procure- 
ments Process, Earned Value Manage- 


ment, Parametric Cost Estimating and 
Project Planning and Scheduling. Com- 
ing soon to the PPMI site will be 
“NASA Best Practices” and “Ask the 
Expats,” an interactive forum to elicit 
guidance from NASA experts across 
the agency. 

This special edition of Issues reaches 
more than 4,000 project managers in- 
side and outside of NASA about twice 
a year. In the previous edition, for ex- 
ample, readers could find the latest 
about ISO 9000, Earned Value con- 
cepts and a half-dozen new acquisition 
initiatives. This current edition was 
planned to satisfy the information needs 
of those who want to know more about 
NPG 7 120.5 A. 

Anticipating new ways of self-paced 
learning, the NASA Training Office 
and PPMI sponsor the NASA Site for 
On-line Learning and Resources 
(SOLAR) online training with the Of- 
fice of Safety and Mission Assurance to 
teach web-based modules on Safety, 
Mission Assurance, Non-Destructive 
Evaluation and a growing number of 
topics. On the horizon are a NASA 
Distance Learning Lab; AdminS tar, an 
automated tool for training registration; 
and an electronic meeting system that 
goes beyond our current capabilities 
with VITS and PictureTel. 

4. Intact Project Team Support 

Recent PPMI advances in information 
technology ostensibly save time, cut 
down on travel and provide specific in- 
formation when it is needed. Similarly, 
we have received a number of requests 
in the past three years for “intact pro- 
ject team support” — made-to-order, 
just-in-time performance support for 
project teams. This training is tailored 
to the needs of the team, such as start- 
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Figure 7. One-Pager Sample 


ups, requirements definition, risk man- 
agement or team building. 

PPMI has already provided Intact 
Team Support for project management 
training, project simulation and consul- 
tation to large and small projects at var- 
ious stages in their life cycles. For ex- 
ample, Project Planning and Scheduling 
for smaller projects may involve four 
long days and nights of tracking mile- 
stones, deliverables and handoffs, re- 
sulting in a computer printout of sev- 
eral feet or meters that shows how one 
component can depend on a dozen or 
more tasks coming together at the same 
time. 


Larger, complex projects use a One- 
Pager approach, developed originally 
for NASA, showing at a glance how 
project managers can chart and inte- 
grate cost, schedule and content 
(metrics) for a particular end item. The 
One-Pager is ideal for projects with 
high cost, long schedule, technical risk 
or key integration intersections. 

Smaller, simpler projects depend on in- 
put/output cards arranged along a long 
wall and connected with color-keyed 
strings to capture the Work Breakdown 
Structure. 

Intact project team support fully sup- 
ports the program and project manage- 
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ment processes and requirements de- 
scribed in NPG 71 20.5 A. More and 
more NASA work today is being ac- 
complished by teams, not individuals 
working alone. As seen all too fre- 
quently, new tools or techniques are 
brought by an individual from a PPMI 
course or other training course to a 
team or project, but the new learning is 
not always relevant to the particular 
project, or it is relevant and yet not 
translated readily into the project or 
recognized as relevant by the other 
team members. 

In a flattened organizational structure 
such as a functional team, all key team 
members are trained simultaneously 
with intact project team support, and 
the training is always adapted to the 
team’s work at hand, not some hypo- 
thetical situation. Team members can 
apply the new learning immediately and 
make observable progress on their pro- 
jects. 

We fully expect to see more requests 
for intact project team support once 
NPG 7 120.5 A takes hold. Under the 
new management directive, a project 
that is well-planned and properly sched- 
uled will have a much better chance of 
survival in the new competitive project 
environment. 

5. Communication of Organizational 
Policy 

Communication of NPG 71 20.5A 
falls in line with the four other goals 
of PPMI. In fact, communication 
of NASA policy integrates these 
efforts and directs each toward a 
single source and summit: the NASA 
Strategic Plan. 

Any effort designed to train, educate 
and enhance the competency of the 
NASA work force should carry out the 


strategic plan of the Agency. Policy 
communication and implementation 
support is all the more important in any 
large bureaucracy, corporation or insti- 
tution. PPMI seeks to provide useful 
and timely information about NPG 
7120.5A to the NASA project manage- 
ment community and communicate 
Agency goals and objectives. Plans are 
already in place to explain the new di- 
rective in print, on CD-ROM, on the 
PPMI home page, through Internet dis- 
cussion groups, in specialized training 
efforts, in revamping the PPMI curricu- 
lum and eventually in a new set of 
Readings, insightful probes of the new 
policy procedures and guidelines. 

This integrated effort to promulgate and 
explain new project management policy 
at NASA thus is five-pronged. The 
NPG 7 120. 5 A now guides the revision 
of all PPMI training and development 
programs and leads to creation of a new 
one — a briefing on the NPG itself. The 
PMDP will be reshaped to take the par- 
ticipating manager through a new pro- 
ject management process and functional 
requirements, from Formulation and 
Approval through Implementation and 
Evaluation. Project management tools 
and information technology will be aug- 
mented with specifics from 
NPG 71 20.5 A, and intact project team 
support will now incorporate the new 
policy directives. Finally, the new pro- 
cedures and guidelines will become part 
of everything PPMI is involved in, in- 
cluding promulgation and explanation 
of the new directive itself. 

In summary, these five-pronged efforts 
will facilitate NASA dialogue across all 
levels of the organization and promote a 
common language across projects and 
function groups in what appears to be 
the most significant change in 40 years 
in the way NASA does business. Just 
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as NPG 7 120.5 A aims to address pro- 
gram and project management in a sys- 
tematic, thorough and integrated way, 
PPMI aims to promulgate it in the same 
integrated fashion. 

NASA’s Crosscutting Processes 

In NPG 7 120.5 A, we are called to man- 
age strategically. As trainers we have to 
remind project managers to keep in 
mind the mandates and requirements of 
our customers, international partners 
and the project’s stakeholders. We need 
to communicate Agency direction and 
decisions clearly, quickly and under- 
standably. As we align our human, ma- 
terial and financial resources with cus- 


tomer requirements, we need to improve 
our acquisition methods and foster lead- 
ership. Finally, we must advance and 
expand our efforts with information 
technology to provide more links with 
experts through our online group com- 
munications, and leverage the valuable 
experience of 1 ,600 NASA PPMI 
alumni so we can get timely answers to 
our urgent technical and managerial 
questions. 

To achieve all this, we need to integrate 
our efforts and interconnect with 
NASA’s crosscutting processes, as out- 
lined in the NASA Strategic Plan. At 
every level, performance will be mea- 
sured twice a year against the goals and 
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Figure 8. NASA ’s Crosscutting Processes 
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objectives outlined in the Strategic 
Plan. Performance-based Contracting 
and other initiatives will change our re- 
lationship with contractors as civil ser- 
vice employees continue to move away 
from detailed operations management 
toward contract oversight roles. And 
while employees will be empowered to 
perform their jobs and project managers 
operate in the new NASA of the 
7 120 . 5 A era, all will be held account- 
able through performance plans for 


meeting their own objectives. Here is 
how the NASA Strategic Plan expresses 
this new way of managing strategically. 

• We will measure our performance 
and communicate our results, 
demonstrating NASA’s relevance 
and contributions to national needs. 

• We will change the way we work 
with our contractors and streamline 
regulations. 



F igur e 9. NASA’s Strategic Management System Documents 
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• We will deliver on our commit- 
ment, be accountable for the suc- 
cess of our programs, and provide a 
balanced and stable aeronautics and 
space program by implementing 
strategic management throughout 
NASA. 

To implement strategic management, 
we must keep the customer and the “big 
picture” in mind. Our challenge in 
PPMI is to make training more useful, 
more focused, and directed more to- 
ward supporting competency develop- 
ment. PPMI now offers 20 courses - 21 
if you include the new 7 120. 5 A briefing 
- more than most universities offer in 
the field of program and project man- 
agement. Yet, our career development 
participants want their knowledge more 
focused than ever. Our training materi- 


als need to reflect the four life cycle 
levels presented in NPG 7120.5A, and 
both our tools and information technol- 
ogy systems must be expanded to sup- 
port this task. 

Finally, the 7120.5A briefings them- 
selves present a performance challenge 
as we try to meet the information needs 
of trainers and diverse audiences. Cur- 
rently, we plan several one-hour ses- 
sions for top-level NASA managers, 
and a three-hour session for all person- 
nel, followed closely by a two-day 
7120.5A overview course at each of the 
Centers. Eventually this new way of 
doing business will spread throughout 
NASA and its project management 
community, resulting in procedures and 
practices that will keep this Agency at 
the forefront of successful innovation. 
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The NPG 7120.5A Electronic Review 
Process 

by Robert 0. McBrayer with Mark Ives 


The use of electronics to review a doc- 
ument is well within the technical 
realm of today’s state-of-the-art work- 
place. File servers and web site inter- 
action are common tools for many 
NASA employees. 

The electronic comment processing 
described here was developed for the 
NPG 7120.5A review to augment the 
existing NASA Online Directives In- 
formation System (NODIS). The 
NODIS system is NASA’s official sys- 
tem for formal review, approval and 
storage of NASA Directives. 

The electronic review process worked 
so well that NASA and other agencies 
may want to consider it as one of our 
“best practices.” It was participatory 
decision making at its very best, a pro- 
cess that attracted dozens of very good 
ideas to improve the document as well 
as the way we can be managing pro- 
jects far more effectively. 

The revision of NPG 7 120.5 A has sig- 
nificant implications for the way all 
elements of the Agency accomplish 
program and project management. 
Therefore, the review of NPG 7 120. 5 A 
was an Agency wide effort with high 
visibility, heavy participation and a 
short schedule. The level of involve- 
ment created interest in supplementing 
the formal NODIS system with a sys- 
tem to collect comments efficiently 
and to allow the Centers and Codes to 
review and consolidate their comments 
into the official system in a short pe- 
riod of time. 


In addition, the Program Management 
Council Working Group (PMCWG), 
responsible for the revision of the doc- 
ument and the disposition of official 
comments, needed an electronic sys- 
tem to manage the disposition of com- 
ments, obtain PMCWG consensus on 
each disposition, and coordinate the 
disposition with the appropriate Head- 
quarters Code that had submitted the 
official comment. The combined 
NASA and contractor talents and re- 
sources provided a system that supple- 
mented the NODIS system and its op- 
erating personnel to produce a thor- 
ough review and approval of 
NPG 7 120.5 A on April 3, 1998, 

7.5 months from the start of the pro- 
cess. The original six-month schedule 
is indicated on Figure 1. All milestones 
occurred on time, except for comple- 
tion of comment disposition, which 
required an additional 30 days. Ap- 
proval of the document occurred six- 
teen days after completion of the 
“Purple Package.” 

The Electronic System 

The NPG 7120.5A electronic comment 
processing system was comprised of 
three consecutive stages: collection, 
consolidation, and disposition (see Fig- 
ure 1). Each of these stages had its 
unique requirements, but the combined 
use of web sites and file servers was 
consistent across all the stages. In ad- 
dition, an Excel spreadsheet was used 
consistently as a data format for the 
last two stages. The first stage, collec- 
tion, used the NASA Program/Project 
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All Comments from all Codes 
available for Disposition 
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All Comments from all Codes 
available for Disposition 
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Figure 1. 


Management (PPMI) web site to dis- 
play the document and comment form. 
The NASA NODIS system also pro- 
vided a link to the document on the 
PPMI web site. The Netscape browser 
could access the web site and submit 
the comments by e-mail to a file server 
data base. 

The second stage, consolidation, used 
the standard NASA e-mail system to 
provide an Excel spreadsheet to each 
of the NODIS Directives Managers for 
comment consolidation. After consoli- 
dation, the comments were transmitted 
electronically to a file server to build a 
new data base and configure comments 
to be either placed in NODIS electroni- 
cally or combined in a new spread- 


sheet for additional consolidation. 

The third stage, disposition, required a 
web site for displaying the document 
revisions as comments were disposed 
of and approved, plus a file server to 
support the dispositioning process. The 
NODIS system was used as the official 
document approval system throughout 
the end of the second stage and the en- 
tire third stage. 

The First Stage 

The first stage consisted of developing 
an online. Internet-based system, test- 
ing the system in a focus group review, 
updating the system, and using the sys- 
tem to collect comments during the 
Agency review process. The system 
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was created to accommodate rapid ac- 
cess to the document and electronic 
comment forms, comment collection, 
and redistribution of comments, using 
the following guidelines: 

a. Display the document and com- 
ment form in a location easily ac- 
cessible electronically, Agency- 
wide. 

b. Provide for collection of com- 
ments in a file server as a data 
base. 

c. Provide for each recipient of the 
comment data to sort the com- 
ments easily according to any of 
the elements of the data base. 

A resizable, split-screen layout was 
designed for the PPMI web page. The 
top of the screen contained the draft 
NPG 7 120. 5 A and the bottom of the 
screen contained the comment form. 
This layout was added to the PPMI 
web page under “What’s New.” A 
Netscape 3.0 (or higher) browser was 
required to interact with the system, 
and Netscape was used to transmit 
comments to the file server upon com- 
pletion of the form. The comment form 
initially contained the following fields: 
Type of Comment (General, Specific, 
Editorial), Chapter number, Paragraph 
number, Issue and Comment. An index 
number, to identify each comment 
uniquely, and the e-mail address of the 
sender were added to the data base and 
included in reports. 

All submitted information was auto- 
matically downloaded and stored in a 
data base, which allowed quick con- 
version of data to word processing, 
graphical and spreadsheet formats. The 
reports were provided in an Excel 
spreadsheet format for ease of sorting, 
and because it is a widely used appli- 


cation. One disadvantage of Excel is 
the 250-character limit on each cell. To 
accommodate longer comments (a few 
exceeded one page), additional cells 
were added adjacent to the initial com- 
ment cell. In some cases, the com- 
ments were provided in a Microsoft 
Word Table for ease of review and 
consolidation. The Word Table did not 
provide the sorting capability that was 
such a valuable feature of the Excel 
spreadsheet. However, the combina- 
tion of these two applications served 
the process very well. 

The PMCWG decided to distribute a 
draft of the NPG 7120.5A to a small 
focus group (less than 100 people) that 
included personnel across the Agency. 
Representatives from Headquarters, 
MSFC, JSC, JPL, LeRC, LaRC, 

GSFC, KSC, Provide Aerospace Prod- 
ucts and Capabilities, the Engineering 
Management Council, Procurement, 
and graduates of PPMI training were 
asked to participate. The purpose of 
this focus group review was two-fold: 
1) determine if the revision was ready 
for Agency wide review; and 2) test the 
comment collection system for poten- 
tial use in the Agency wide review. The 
focus group review occurred August 
18-21, 1997, employing user name and 
password access to the electronic doc- 
ument and comment form. This review 
produced 657 comments that resulted 
in a complete reformatting of the docu- 
ment and in revisions to the comment 
collection system. 

A meeting of the PMCWG was held 
August 25-28, 1997, to assess the re- 
sults of the focus group review and 
prepare the draft NPG 7 120. 5 A for 
Agency Review. The PMCWG used an 
Electronic Meeting System, developed 
by the Training and Development Di- 
vision of NASA Headquarters, to ob- 
tain a group priority on the comments 
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received. As a result of the focus group 
review, several changes were made in 
the system that would be used to sup- 
port the Agency review: 

a. A support team was formed to pro- 
vide on-site assistance to commen- 
tors and Directive Managers at all 
the Centers and Headquarters 
Codes. 

b. The document would remain on 
the split screen, but the capability 
to download the entire review draft 
in Microsoft Word was added to 
the web page. 

c. The commentor’s Center and Mail 
Code were added to the comment 
form fields to aid sorting. 

d. The Excel spreadsheet was re- 
tained as the report format. Addi- 


tional columns were added to con- 
tain comments longer than 
250 characters. 

e. Weekly reports to the Directive 
Managers were instituted. 

f. No user name/password would be 
used for the Agency Review, but 
access to the PPMI web page ex- 
cluded any e-mail address that did 
not end in “nasa.gov.” 

g. Video/telecons (ViTS), similar to 
the focus group review, were 
scheduled to brief the content of 
the document and the process for 
the Agency wide review. 

h. A test period, similar to the focus 
group review, was scheduled for 
participants to access the web site 
and submit test comments. 



Figure 2. 
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The support team formed to provide 
on-site assistance to commentors and 
Directive Managers at all Centers and 
Headquarters Codes was intended to 
focus key elements on the review pro- 
cess. Each Center/Code support team 
was comprised of the Directives Man- 
ager (responsible for the document re- 
view), a PMCWG representative (to 
answer any questions about the docu- 
ment and help with comment consoli- 
dation), and a computer support repre- 
sentative (to help with the electronic 
exchange or recompiling of com- 
ments). A special briefing on the re- 
view system and process, directed at 
the support team, was held 
September 22, 1997. 

The results outlined above were incor- 
porated into the system and the process 
for the Agency Review and comment 
collection. The Agency Review began 
on September 29, 1997, and closed on 
October 31, 1997; a total of 1,672 
comments were submitted. The totals 
by week were: first week, 21 com- 
ments; second week, 65 comments; 
third week, 168; and the fourth week, 
578 comments. The electronic system 
handled 1,094 comments in the final 
week. All 1,672 comments were then 
collected by Center and Code, and the 
individual Excel spreadsheets were re- 
turned to the respective Centers and 
Codes in four days, two days ahead of 
schedule, for consolidation. 

The Second Stage 

The second stage was comprised of 
sorting and returning the comments, 
Center and Code review and consoli- 
dation, and placing the final comments 
into NODIS, as indicated in Figure 2. 
The electronic form of the comments 
provided the capability to quickly sort, 
package and distribute the comments 
back to the source organizations for 


consolidation. Each Center and Code 
received the comments that came from 
their organization in an Excel spread- 
sheet. The 250-character limit on cells 
was a disadvantage for lengthy com- 
ments, but the flexibility offered by 
Excel to sort the comments according 
to any field was a significant advan- 
tage. 

After October 31, 1997, a data base of 
all the comments was entered into the 
system. Each comment was given a 
unique index number and packaged in 
the Excel spreadsheet. The spread- 
sheets were sent to all the different 
Centers, and they contained all the 
comments that came from that Center. 
The Centers then took those comments 
and went through a discarding and 
consolidating process. The resulting 
data was sent back and combined and 
distributed to the Institution Program 
Officers (IPOs). They went through a 
similar comment combination and con- 
solidation process that would result in 
final comments to go in the NODIS for 
disposition. The Headquarters Codes, 
other than IPOs, received their com- 
ments, and had more time to process 
their comments and get theirs entered 
into NODIS. This all took place be- 
tween October 31 and December 12, 
1997. Many of the Centers did an ex- 
cellent job of consolidating the com- 
ments for their IPOs. 

The PMCWG worked with the Head- 
quarters Code JM, Management As- 
sessment Division, to prepare the final 
comments for electronic entry into 
NODIS. After consolidation by the 
IPOs and other Headquarters codes, 
the comments were provided to us 
electronically. We indexed the com- 
ments and put them in a format that 
could be electronically inserted into 
NODIS under the appropriate Code. 
This ensured that all comments had a 
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unique index number and relieved the 
Directives Managers from having to 
enter their comments manually. A total 
of 547 comments were entered into 
NODIS for dispositioning. 

At the same time the comments were 
released into NODIS, we placed the 
comments into a separate electronic 
system that would permit the PMCWG 
to work throughout the disposition 
stage. 

The Third Stage 

The third stage included disposition of 
the final comments, revising the docu- 
ment to include the dispositions and 
obtaining concurrence of the Officials- 
in- Charge. The responsibility for dis- 
position of each Headquarters Code’ s 
comments was assigned to PMCWG 
members located at Headquarters. 


These assignments were essentially the 
same as assignments for the Agency 
Review Support Team. Support was 
provided from other PMCWG mem- 
bers and other Center and Headquar- 
ters personnel. The process for PM- 
CWG processing of the comment dis- 
positions is depicted in Figure 3. 

The web page developed for this activ- 
ity is shown in Figure 4. 

Each box included the comments from 
the respective codes and a form for en- 
tering the comment disposition 
(Figure 5). 

Upon completion of the disposition, 
comments were sent to a file server 
and was placed in the “Proposed Dis- 
position” file. The dispositions in that 
file were reviewed in a series of PM- 
CWG telecons. The purpose of the 


NODIS/PMCWG Processing | 



Figure 3. 
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Code J Approval Process 



Figure 6. 


telecons was for the PMCWG to agree 
on the disposition of each comment. 

All dispositions provided by Friday 
close of business were included in the 
following Wednesday telecon. The 
typical agenda for these telecons in- 
cluded: major issues status, lead re- 
ports and proposed disposition discus- 
sion. After approval by the PMCWG, 
the disposition was integrated into a 
copy of NPG 7120.5A; revision notes 
and a log were kept to indicate where 
each comment was included in the 
document. In addition, the approved 
disposition was inserted in the NODIS 
disposition block. A hyperlink was 
provided in NODIS to permit those re- 
viewing the NODIS dispositions to see 
where the comments had been incorpo- 
rated into the revised document. This 
process was used in the disposition of 
all the final comments. Upon comple- 
tion of the dispositioning, the revised 


document was reviewed by technical 
editors and finalized. Officials-in- 
Charge concurred in the dispositions, 
or the dispositions were presented to 
senior management for resolution. A 
summary of substantive comments was 
prepared and included with the final 
document and the concurrences. This 
package was provided to Headquarters 
Code JM for processing. The Code JM 
package was provided to the Head- 
quarters Legal office and the Adminis- 
trator’s Correspondence Office for 
their concurrence, and then sent to the 
Administrator for signature. The flow 
diagram for the Code JM processing of 
the Agency Review products is shown 
in Figure 6. 

Throughout this comment disposition 
stage the dispositions were developed, 
coordinated and approved by the 
PMCWG. The approved dispositions 
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were used to revise a draft of NPG 
71 20.5 A, and this draft was available 
for viewing by the Headquarters Direc- 
tive Managers and Officials-in-Charge. 
Code JM ensured that the NODIS sys- 
tem concurrences were included for all 
comments and dispositions, assembled 
the “Purple Package” and staffed it 
through the final approval phase of the 
process. 

In summary, the electronic comment 
processing system collection, 
consolidation and disposition required 
careful planning and close coordina- 


tion between NASA and contractor per- 
sonnel. The process was quick, efficient 
and thorough; it exceeded our expecta- 
tions and resulted in a better, richer 
document. 

The technology is now available to al- 
low faster, cheaper and better reviews 
using electronic systems that are already 
in place within NASA. The system de- 
scribed here should be used as a spring- 
board to develop even better ways to 
conduct electronic reviews, and improve 
the efficiency of the NASA work force 
in meeting future challenges. 
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Risk Management Structured 
for Today’s Environment 


by Dr. Michael A. Greenfield 

Today’s project management environ- 
ment provides NASA with myriad 
challenges. We have smaller budgets 
and, consequently, smaller programs 
and shorter lead times. We have less 
money for development, and no money 
to recover from contingencies or 
mishaps. The NASA Administrator is 
leading the Agency away from opera- 
tions, instilling a renewed focus on sci- 
entific research and the development 
and application of new cutting-edge 
technologies. We are using 
performance-based and fixed-price 
contracts with industry, and we are 
forming more and more partnerships 
with the international community. 

In addition to the environment, we 
have many NASA-unique conditions 
that challenge mission success. They 
include a higher level of performance 
requirements, limited production num- 
bers, higher development efforts and 
cost, the inability to operate a space 
element fully under realistic conditions 
on the ground, limited access to the 
product during operation, and, of 
course, the need for more science for 
fewer dollars and on a shorter sched- 
ule. 

Faced with these new challenges, we 
quickly realized that only a robust, 
Agencywide approach to risk manage- 
ment would provide the assurance of 
success we required. In NPG 7 120. 5 A, 
we define risk management as “an or- 
ganized, systematic decision-making 
process that efficiently identifies, ana- 
lyzes, plans, tracks, controls, and com- 
municates and documents risk in order 


to increase the likelihood of achieving 
program/project goals.” Effective risk 
management depends upon a thorough 
understanding of the concept of risk, 
the principles of risk management and 
the formation of a disciplined risk 
management process. 

In human spaceflight programs, NASA 
has always maintained a rigorous and 
highly structured risk management ef- 
fort. When lives are at stake, NASA’s 
missions must be 100% safe; the risk 
management approach used in human 
spaceflight has always been compre- 
hensive. 

In spacecraft and technology programs, 
however, NASA’s history of risk man- 
agement implementation has been spo- 
radic. In some cases, the deployment 
of risk management resources and as- 
sistance was not based solely on objec- 
tive data, but rather on the “squeaky 
wheel” principle. The most vocal sub- 
system manager received risk mitigat- 
ing resources. Furthermore, risk man- 
agement was interpreted, more often 
than not, as risk aversion. Massive re- 
sources were poured into large pro- 
grams late in the life cycle to make 
sure that risks were avoided at all 
costs. This uneven approach to risk 
made it difficult to gather and use past 
risk management experience, and there 
was no formal process for the commu- 
nication of risks and impacts. 

In addition to being inconsistent, 
NASA’s traditional risk management 
efforts in spacecraft and technology 
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programs can be described as risk 
management by rote, or as a rule-based 
approach. The rules were based upon 
the mission classification, and NASA 
missions were classified on the basis 
of their importance and priority to the 
Agency. 

NASA Management Instruction (NMI) 
8010.1 A established the risk manage- 
ment rules for each classification. This 
policy delineated the elements for mis- 
sion success and safety, reliability, 
maintainability and quality assurance 
(SRM&QA). It provided requirements 
for engineering models, the number of 
spares, treatment of single failure 
points, the grade of EEE parts, testing, 
types of reviews and other factors for 
each classification, regardless of the 
specifics of the mission. This rule- 
based approach did not provide the 
program manager with any flexibility 
to tailor the effort to the program 
needs. 

Thus, the requirements for risk man- 
agement were inflexible and the appli- 
cation inconsistent. But without a 
doubt, the most significant void in 
NASA’s previous risk management 
approach was the failure to completely 
integrate risk management into pro- 
gram management. NPG 7 120.5 A im- 
proves NASA’s risk management pro- 
cess to correct these deficiencies. 

NPG 7 120.5 A establishes the manage- 
ment system to support the develop- 
ment and operation of aeronautical, 
space, ground and flight systems and 
technologies that make up the Agency 
crosscutting process titled “Provide 
Aerospace Products and Capabilities.” 
NPG 7 120. 5 A documents the pro- 
cesses, requirements and responsibili- 
ties comprising an ISO 9000-compliant 
management system for implementing 
NASA’s programs and projects. It pro- 


vides the guidance necessary to trans- 
fer methods used in the disciplined risk 
management process associated with 
human spaceflight programs into all 
NASA programs, including spacecraft 
and technology programs. 

Risk management is an overarching 
theme of NPG 7120.5A. Specifically, 
the guidelines require that program de- 
cisions be based upon an orderly risk 
management effort, including the iden- 
tification, analysis, planning, tracking, 
and control of risks throughout the life 
cycle. (The new NPG breaks out a pro- 
gram life cycle into four subprocesses: 
Formulation, Approval, Implementa- 
tion and Evaluation.) NPG 7120. 5A 
requires that program managers de- 
velop a risk management plan upfront 
in the Formulation stage of a program, 
and then execute and maintain the plan 
during the Implementation phase. The 
implementation and maintenance of a 
safety management program is a re- 
quired element of the Risk Manage- 
ment Plan. 

Concept of Risk 

Before we look more in depth at 
NASA’s risk management process, we 
should first establish what we mean by 
“risk.” Risk means different things to 
different people. “Risk” can mean an 
event — like the loss of communica- 
tions. “Risk” can mean a possibility or 
probability — like a 10% likelihood of 
mission failure. For some, “risk” is the 
product of likelihood times severity. 
Some think “risk” is what you take; 
some think “risk” is what you avoid. 
NASA has defined “risk” as “the com- 
bination of 1) the probability 
(qualitative or quantitative) that a pro- 
gram or project will experience an un- 
desired event such as cost overrun, 
schedule slippage, safety mishap, or 
failure to achieve a needed technologi- 
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cal breakthrough; and 2) the conse- 
quences, impact, or severity of the un- 
desired event were it to occur.” Pri- 
mary risks are those undesirable events 
having both high probability and high 
impact. Risk management, then, is an 
organized and systematic decision- 
making process that identifies risks, 
assesses their impact and likelihood, 
and effectively prioritizes them for 
mitigation or elimination. 

Risk management activities are pre- 
scribed throughout the entire program, 
from Formulation to Evaluation. The 
initial Program Commitment Agree- 
ment, in which the program manager 
details the entire program, requires the 
program to identify and document the 
areas of highest risk, including the spe- 
cific primary risks, the proposed ac- 
tions to mitigate risks, and the reserves 
and allowance for program adjustment 
(APA) allocations. This upfront re- 
quirement to address risk management 
formally is a critical step toward suc- 
cessful programs. In addition, the Pro- 
gram Plan requires documentation of 
the risk management strategy and pro- 
vides a template to make sure that risk 
management planning is complete. The 
Project Plan requires similar risk man- 
agement planning. 

In the past, NASA’s development pro- 
cesses were characterized by extensive 
analyses, numerous reviews and multi- 
ple, conservative tests. This methodol- 
ogy was consistent with the long avail- 
able schedules for developing the hard- 
ware and software for very large, 
billion-dollar missions. Today’s envi- 
ronment calls for value-based tests and 
analysis, and knowledge-based rather 
than rule-based risk management. In 
other words, the program manager will 
not conduct a series of tests from a 
prescribed checklist. Rather, the pro- 


gram manager will determine the ap- 
propriate level of tests, tailored to the 
specific program. From the results of 
value-based testing and analysis, the 
program manager can categorize and 
quantify the risks according to proba- 
bility, impact, and the time frame in 
which mitigating action must be taken. 

Principles of Risk Management 

The Risk Management Plan is devel- 
oped in the Formulation phase. It 
clearly defines the process by which 
the program/project manager will ad- 
dress risk issues and decisions. Much 
like a Project Plan, it defines who has 
risk management responsibility, what 
processes will be used for risk identifi- 
cation, analysis, and ranking, and how 
decisions will be tracked. 

Figure 1 shows the primary elements 
of the risk management process re- 
quired by NPG 7 120.5 A. The first in- 
put into the process is the definition of 
project constraints. Project constraints 
include those factors that affect the 
success of the overall program and, 
therefore, guide the development of 
the policy that will be used to make 
risk decisions. Examples may include 
mission success criteria, schedule, 
budget, international partner participa- 
tion, human spaceflight safety issues, 
technology readiness, oversight re- 
quirements and legal, environmental or 
political issues. 

Once the program constraints are de- 
fined and understood, the program 
manager can identify general risk is- 
sues and concerns. These relate to 
questions such as “What objectives are 
at risk in such key areas as manage- 
ment, technology development, engi- 
neering, manufacturing, and opera- 
tions?” 
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Program/Project data/contraints 


Risk data: test data, expert opinion, 
hazard analysis, FMEA, lessons 
learned, technical analysis 


Resources 


Program/project data 
(metrics information) 



Statements of risk 
List of risks 


Risk evaluation 
Risk classification 
Risk prioritization 


Risk mitigation plans 
Risk acceptance rationale 
Risk tracking requirements 


Risk status reports on: 

• Risks 

• Risk mitigation plans 


Risk decisions 


Figure /. Risk Management Process . 

MOTE: Communication and documentation extend throughout ai! of the functions . 


The second step in the risk manage- 
ment process involves risk analysis. It 
is during this step that you quantify 
your risks, an initial screening that will 
produce a prioritized risk list for ac- 
tion. Most risks will fall into a cate- 
gory of having little likelihood of oc- 
currence or only limited consequences. 
These must be tracked, but real atten- 
tion must be paid to those that repre- 
sent severe threats to the program. 

In step three you ask the question: 
“What can I do about these high conse- 
quence, high likelihood risks?” Miti- 
gation actions can reduce the likeli- 
hood of occurrence or the severity of 
the consequence to the project. Actions 
can include such things as redesign, 
changing requirements, acquisition of 
more resources (both in dollars and 
time), the development of contingency 
plans, etc. Risk mitigation includes re- 


sponsibilities, methods, schedules and 
outcomes. A word of warning — too 
much risk aversion is a natural ten- 
dency but this approach can actually 
increase other risks by absorbing too 
many critical resources that might be 
better deployed elsewhere. 

Risk as a Tradable Resource 

When analyzing risks and determining 
appropriate mitigation, particularly in 
an environment of limited resources, 
the project manager knows tailoring 
plays an important role in mission suc- 
cess. In the human spaceflight area, 
program managers are constrained in 
the amount of safety risk that can be 
accepted, and rightly so. However, 
when developing risk mitigation for 
non-human spaceflight programs, the 
program manager has more latitude to 
optimize overall risk posture through 
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accepting risk in one area to benefit 
another. Figure 2 depicts risk as a trad- 
able resource. Throughout the resource 
allocation and hardware development 
phases of a project, risks are addressed 
and resources traded off, including 
mass, power, cost, performance, sched- 
ule and risk. Benefit analysis is key. 
This new paradigm, “Risk as a Re- 
source, ’’ allows for recognized risks 
and concedes that there may be some 
failures. However, the Agency can af- 
ford to conduct many more missions 
by employing risk as a resource in an 
integrated approach to risk manage- 
ment. 

Once the risk mitigation actions have 
been completed, the risk management 
process calls for tracking, which 
includes verification and validation 
(V&V) of mitigation actions. V&V 
usually involves a combination of 
inspections and tests to assure that 
a mitigation action has been imple- 


mented and that it works. Once V&V 
is complete, all primary risks must be 
controlled (the next step of the risk 
management process). A risk is consid- 
ered “controlled” or “retired” when 
any one of the following conditions are 
satisfied: 

• Risk mitigation options that reduce 
the probability of occurrence to an 
acceptable level have been planned 
and will be implemented; 

• All reasonable mitigation options 
(within cost, schedule and techni- 
cal constraints) have been insti- 
tuted, and the risk has been judged 
to be “acceptable” by a governing 
PMC; or 

• Reserve funds are available to 
recover from cost, schedule and 
technical impact, should the risk 
actually occur. 



Figure 2. Risk as a Resource 
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The risks and mitigation actions are 
continually documented and communi- 
cated throughout the program life 
cycle. This documentation supports 
assessment of the effectiveness of the 
mitigation, reevaluation of the risk, 
and the ability to understand how other 
project actions may affect decisions 
already made. Additionally, such 
documentation serves as a valuable 
source of lessons learned for future 
programs. 

NPG 7120.5A establishes risk manage- 
ment as an integral part of program 
management, to be implemented 
throughout the program life cycle. The 
process and documentation require- 
ments, when complete, constitute a 
thorough risk management effort. It 
calls for an upfront risk management 
plan, and provides guidelines to ensure 
that the appropriate risk analysis is 
conducted and proper mitigation is in 


place, commensurate with the specific 
needs of the program. 

NASA’s environment, both fiscally 
and programmatically, has changed 
dramatically in the past few years. 

We must adapt to the changes and 
understand the unique conditions that 
face the Agency. The rule-based 
approach that we used to control risks 
in large budget programs will not work 
with today’s lower cost missions. We 
must tailor our risk analysis and miti- 
gation to the specific needs of the 
program, and now consider resource 
trading, including risk, to achieve the 
maximum return on investment. 

Effective risk management, as outlined 
in NPG 7 120.5 A, is a necessary and 
practical aspect of improved program 
management now and in the new 
millennium. 
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by Dr. William M. Lawbaugh 

NASA maintains an online library for 
official documents called NASA On- 
line Directives Information System 
(NODIS) Library that provides access 
to a wide range of requirements appli- 
cable to NASA programs and projects. 
This library is updated as new require- 
ments are approved. 

To access the NODIS Library page, go 
to URL: http://nodis.hq.nasa.gov 
This will provide you access to the 
NASA Strategic Plan , NASA Manage- 
ment Handbook and Agency and Cen- 
ter Directives. Access is also provided 
to Federal regulations, Executive or- 
ders, OMB Circulars, Technical Stan- 
dards, Charters and Financial Manage- 
ment Manuals. 

Technical Standards. The Agency- 
preferred standards may be viewed at 
URL: http://standards.nasa.gov 

Charters. The Agency Program Man- 
agement Council Charter may be 
viewed at URL: 
http://nodis.hq.nasa.gov/ 

Nodis 1 . 1/attachments/pmc charter.doc 

Information Sites. The NASA Pro- 
gram and Project Management Initia- 
tive (PPMI) may be viewed at URL: 
http://ppmi.hq.nasa.gov 

The PPMI Home Page also provides an 
ever-expanding number of links to sup- 
porting resources for program and pro- 
ject management, as well as for NPG 
7 120.5 A. 


• Training and Curriculum 

All PPMI courses are listed and 
described 

• PMDP 

NASA’s Project Management 
Development Process is charted 
and explained 

• NASA Lexicon 
References, definitions and 
acronyms for NPG 7 120.5 A 
and Agency programs 

• NASA Strategic Plan 

The latest version, an indis- 
pensable resource 

• NASA Strategic Management 
Handbook 

The guidebook for integrat- 
ing strategic planning with the 
NASA budget process 

The PPMI web site will also link you 
to a vast array of learning resources for 
enlightened project management. 

• NASA Fast Tracks Study 
Details of best practices, lessons 
learned and success stories on 
“better, faster, cheaper” projects 

• Superior Projects Team Study 

A new study of successful NASA 
work teams, based on Dr. David 
Kinlaw’s research 


Resources 
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• Project Excellence Through 
Storytelling 

A novel approach to the study of 
successful NASA projects by the 
leaders sharing their experiences 

• Best Practices 

Results of online surveys of NASA 
project managers, arranged in a 
matrix with direct links to the best 
practitioners 

• Distance Learning 

An ongoing survey of successes 
and failures in other government 
agencies and leading edge compa- 
nies in online instruction 

• Case Studies and Lessons Learned 

Analysis of successful strategies 
used on “better, faster, cheaper” 
projects like NEAR 

• PM Coach 

Under construction, in-depth 
coaching on key tools and tech- 
niques specified in NPG 7 120. 5 A 


• PPMI Listserv 

An email list service of PPMI pro- 
gram alumni used to raise ques- 
tions and broadcast topical infor- 
mation. The list contains more 
than 1,500 addresses. Request sub- 
scription by typing “subscribe” in 
the message area (leaving the sub- 
ject line blank) and send to 
ppmi@hq.nasa.gov 

• SOLAR 

NASA’s Site for On-line Learning 
and Resources for SMA training 
plus curricula and catalogs 
http://solar.msfc.nasa.gov 

• Lessons Learned Information 
System 

Lessons learned from nearly 
40 years in the aeronautics and 
space business for better safety, 
reliability, maintainability and 
quality. 

http://llis.gsfc.nasa.gov 
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with for Government certification. This and Control Fundamentals, internal system, EVM status 

course builds on the knowledge and skills reporting requirements, interpretative 

taught in Program Management and analysis of EVM status reporting. 

Control Fundamentals , determination of contract estimate at 

completion. 
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